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Abstract 

We describe the universe as a single entangled ensemble of quantum particles. The 
total entropy of this world ensemble, which can be expressed as a sum of information, 
thermodynamic and entanglement components, is assumed to be always zero. This con¬ 
dition suggests information quantization, which we associate with the Planck’s action. 
Then the entropy neutrality condition for the universe leads to the zero-action principle. 
We show that the main concepts of classical space-time and gravity naturally emerge in 
this picture. A generalized least action principle, which embraces the maximal entropy 
principles of information theory, is introduced. 
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1 Introduction 

Many authors consider the so called emergent theories [1] in which classical space-time is not a 
fundamental concept [2-6] and gravity is defined only for the matter in bulk (like thermodynam¬ 
ics or hydrodynamics) and not for individual elementary particles [7-11]. In understanding the 
origin of gravity, which is far from being complete, and its relations to other interactions in the 
universe the information-probability methods may play a central role. The key concept in this 
direction is entropy, which is a powerful tool in thermodynamics and information and quantum 
theories. Entropy is an additive quantity in general, having distinct ingredients, what allows us 
to model different aspects of physical systems using a similar mathematical framework. 

In classical thermodynamics the Boltzmann’s entropy [12,13], 

^ = lnV, (1) 

quantify the amount of information that is lacking in order to identify the microstate of a system 
from N possibilities^, which are compatible with the given macrostate. 

^Throughout the paper we measure entropies in nuts and assume the Boltzmann’s constant = 1. To 
convert the entropy into bits one can perform the standard replacement, In ln 21 og 2 . 
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In information theory, entropy is a measure of the uncertainty of information associated with 
some random variable. In this context, the term usually refers to the Shannon’s entropy [14], 


N 


I = - ^Pi\npi , 


( 2 ) 


2=1 


where pi denotes the probability that an entity will be the z-th. 

Entropy in quantum mechanics corresponds to the lack of information about the outcomes 
of a measurement process. For either a pure state specihed by a wave function, or a mixed state 
specihed by a density matrix p the amount of (or lack of) information about the elements of a 
quantum system is usually measured by the von Neumann entropy [15-17], 


S = —tr (pin p) 


(3) 


This kind of entropy captures both classical and quantum uncertainty, i.e. it contains additional 
information concerning the quantum entanglement, which is not present in the density matrices 
of subsystems. A quantitative description of this quantum property, the entanglement entropy, is 
a form of information entropy that describes needed information to have a full knowledge about 
other parts of the quantum system. The entanglement entropy is being used for a wide spectrum 
of models like quantum information processing [16,17], quantum phase transitions [18,19] and 
black holes [20-22]. It is different from the standard statistical entropy (1) in many respects, 
but several characteristic thermodynamic relations remain valid [23,24]. In some models the 
entanglement entropy even is found to be divergent [25-27]. 

Entropy in physical theories quantihes two seemingly opposite entities: uncertainty (or igno¬ 
rance) and information (or order). However, there are deep reasons to expect relations between 
different kinds of entropies [28], since using information an observer can manipulate physical 
systems and change their thermodynamic or quantum entropies. For instance, the Shannon’s 
entropy (2) reduces to the Boltzmann’s one (1) when an observer assumes the equal probabilities 
for each macrostate, 

(4) 


Pi = 


N 


It is known that the Shannon entropy of the ensemble is strictly greater than the von Neumann 
entropy whenever the states in the ensemble are non-orthogonal [29]. So for quantum systems 
we have the relation, 

J > 5 , (5) 

that means that there is more uncertainty in a single observable than in the whole of the 
quantum state described by a density matrix. The equality in (5), or the reduction of von 
Neumann’s entropy (3) to the Shannon’s one (2), holds for diagonal density matrices. 

In general, identihcation of information and thermodynamic entropies is not valid, / is a 
subjectively dehned quantity, and it is meaningless without an observer for which the proba¬ 
bilities Pi are dehned. While S is an objective, an observer independent quantity. A physical 
system has a hxed value of S', whether one knows identity of the microstate or not. When 
the observer knows in which microstate the system is, I becomes zero (all pi-s in (2), except 
of one, are zero), but S is unchanged. So the concept of entropy in physics is far from being 
well understood. An example is the case of black holes, where we are not able to associate the 
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entropy with a counting of microstates. In addition, as a consequence of the Unruh effect, it 
appears that the number of microstates might be related to the motion of the observer. This 
suggests that a more general dehnition of entropy than introduced by Boltzmann, Shannon or 
von Neumann might exist. Examples of the alternative entropy concepts are the Renyi and 
Tsallis entropies, relative entropy, entropy density, etc. [15-17,29]. We can mention two reasons 
that entropy to be a mysterious concept: (i) the contradiction between the time-irreversible 
second law of thermodynamics and the time-reversal invariant laws of microphysics and (ii) the 
fact that the process of coarse-graining by which one dehnes which states are indistinguishable 
is partially subjective. 

We can strictly relate the information and thermodynamic entropies with each other by 
adopting the principle of information-entropy conservation for any closed system, be it classical 
or quantum [30]. This principle is true for classical systems, due to the conservation of phase 
space volume in Hamiltonian dynamics, when a distribution function evolves according to the 
Liouville theorem. In the case of information theory, the total entropy of the information coding 
device plus its environment is conserved, since the thermodynamic entropy for the environment 
increases after the erasure of information. Another example concerns the famous Maxwell 
demon paradox with the violation of second law if one ignores demon’s information and where 
the entropy remains conserved only for the complete system of the demon, the gas and the 
environment. The fact that information is physical takes on a more demanding role for quantum 
case, where information can neither be cloned [31] nor deleted [32]. In quantum teleportation 
process the information conservation manifests itself when a reconstruction of the unknown 
initial state at the receiver requires a classical communication channel linking to the sender, 
and the information transfer is limited by the speed of light [33]. 

If we adopt the principle of information-entropy conservation we should conclude that due 
to the second law of thermodynamics (that the statistical entropy always increases) in standard 
dehnitions of total entropy of a physical system some negative component is missing. While 
the usual dehnitions of entropies, like (1), (2) and (3), are non-negative, it appeared that the 
conditional entanglement entropy, 

H = Slot — S , ( 6 ) 

where Stot denote the joint entropy of quantum states and S is the marginal von Neumann 
entropy of subsystems, can be negative [29,34-41]. This kind of entropy is known as the useful 
tool for quantitative measure of the entanglement of a quantum system with many degrees 
of freedom [42,43]. The examples with negative H are the pure entangled quantum states, 
which have stronger than classical spatial correlations, when one can be more certain about 
the joint state of a quantum system than about any of its individual parts. Then in complex 
models, which use combinations of different types of entropy, confusions with the sign can 
arise. An example is the von Neumann’s multi-component measurement scheme, in which 
the quantum system, memory (or apparatus), and the observer himself are involved, and the 
entropy component for memory yields a negative value. There have been a number of notable 
interpretations of the negative entanglement entropy, as a potential information [44], a reversible 
work [45], or a memory hlling the system similar to the Dirac’s sea [46]. 

The fact that the joint quantum entropy Stot in (6) can be less than a sum of marginal 
entropies of subsystems, S, is one of the most fundamental differences between the classi¬ 
cal and quantum information, and it is a key observation in quantitative realization of the 
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principle of information-entropy conservation used in informational interpretation of quantum 
mechanics [47-49]. This principle allows creation of entropy in the measurement device which 
is counterbalanced by the negative entropy of the quantum system itself, and results in the 
conservation of the total entropy in the measurement process. In informational models the 
collapse of the wavefunction does not occur and the quantum probabilities arise in the unitary 
time development of the measurement thanks to the negative entropy of the ’unobserved’ quan¬ 
tum system. For example, the decrease of entropy during the black hole evaporation is exactly 
balanced by the increase of entropy in the emitted radiation, so that the complete process of 
Hawking radiation in this model is unitary. 

It is known that ’classical’ dehnitions of entropy lead to problems, when one tries to apply 
them to the whole universe. If the universe at the early stages was in equilibrium (as the CMB 
appears to suggest), already having a maximal S, its entropy could not have increased over its 
lifetime. Therefore, the initial value of the ’universal’ entropy should be close to zero, as this is 
in the case of von Neumann’s entropy for a single universe model (with no observers outside), 
which is in a huge pure state. This is in contradiction with the fact that thermodynamic entropy 
for the universe is enormous. The signihcance of this paradox was pointed out long ago [50] 
and still there is little consensus about how to dehne the maximal and minimal values, and the 
evolution rate of the entropy for the universe [51]. 

2 Zero-entropy principle 

In our opinion, a satisfactory model of the entropy for the universe can be obtained using the 
ideas of information interpretation of quantum mechanics [47-49], in which a measurement is 
considered as the interaction of three systems: the quantum object, memory (measurement 
device) and observer. Then the total entropy of the universe can be assumed to be zero (as 
it is suggested by von Neumann’s model) and, formally, it can be written as the sum of the 
information, statistical (thermodynamic) and quantum (entanglement) components [46,52], 

I + S + H = 0 . (7) 

This relation is the special case of Schmidt’s decomposition for the entangled composite system 
in pure state and it follows from Araki-Lieb inequalities [53]. According to the information 
interpretation, the universe always remains in pure state, i.e. it obeys (7) due to the balancing 
of the randomness in the I-S mixed state of the observer and the measurement device with the 
negative conditional entanglement entropy (6) with the rest of the universe. Since the model 
only allows a unitary time-evolution, the ’universal’ entropy (7) remains zero at all stages of 
the universe’s evolution, while any subsystem has non-zero entropy. 

The condition of entropy neutrality of the universe (7) suggests the information quantization 
[48,49], such as the discreteness of the charge might be thought as the consequence of the 
validity of Gauss’ law for the electrically neutral hnite universe. Since information is physical, 
the existence of the unit of information [47] should be associated with some physical parameter, 
like energy or mass [54-56], according to the Landauer [57,58] and Brillouin [59] principles, 
respectively. However, these parameters cannot serve as adequate measures of information, 
since it is possible for a system to lose information stored in the degenerate states without 
losing energy [60,61]. Also, there is no unique standard of mass and energy, which is additive 
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as the electric charge. Moreover, mass and energy have no polarity and usnally are taken to be 
positive. 

In onr opinion the convenient physical parameter to measnre information is the action A, 
which is an additive qnantity like entropy, and it also contains positive and negative compo¬ 
nents and exhibits the nniqne discrete valne, the action qnantnm h [62]. Thus we assume that 
thermodynamic component of entropy is proportional to the classical action of the system, 

( 8 ) 

This relation translates the condition of entropy neutrality of the universe (7) into the null 
action principle - the sum of all components of the action for a physical system (including the 
boundary terms) is zero. The consequences of the null-action principle are the appearance of 
different conservation laws in physics, be it discrete or continuous, and the zero-energy condition 
for the whole universe, which implies that the universe can emerge without violation of the 
energy conservation [63,64]. The assumption (8) also means that the minimal information, 
which is encoded in the response of the universe to the transfer of the elementary action, 

Amin h , (9) 

describes the value of the Boltzmann’s constant, which is presents in (8) as ks = 1. 

We want to show that the main concepts of classical space-time and gravity naturally emerge 
within the information-probabilistic model of the universe considered as the unihed ensemble 
of entangled quantum particles [65-67]. 


3 Time arrow 

The emergence of the direction of time in our model is a consequence of the second law of 
thermodynamics written for a quasi-isolated system of particles with 

H = const . (10) 

The system can be in k different conhgurations with the probabilities 

Pk ~ , (11) 

where Sk are the conditional thermodynamic entropies of these conhgurations. We can assign 
an ordering of conhgurations in a natural way, since there are no two of them with the same 
weight, and the conhguration labeled by ki contains the conhguration ^2 if 

Sk, > Sk, . ( 12 ) 

Therefore, the entropy of the conhguration Sk can play the role of a time parameter and the 
maximum thermodynamic entropy principle [68] incorporates an intrinsic directionality in this 
entropic time: the maximal probability to be observed has a conhguration with the largest Sk 
corresponding to the latest time. Indeed, for the conhgurations with Sk, and Sk, the conditional 
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probability Pki\k 2 (information about the configuration /c 2 is known) is related to the reverse 
conditional probability Pfcjlfci according to the Bayes’ theorem [69], 

Pk2Pki\k2 Pk\Pk2\k\ • (^2) 

In other words, one of the two conditional probabilities, but not both, can be given by the 
maximum entropy distribution. Note that the Bayes law expressed in terms of I and S', which 
are related to the probabilities via exponents, is equivalent to (10), or, according to (7), 

I + S = const , (14) 

and shows that for the quasi-isolated systems the entropic and physical times are correlated. 

Note that for a quantum system, by specihc measurements which reduce marginal entropies 
in H, it is possible to achieve the state with 

I + H Tn const . (15) 

This situation with 

S ~ const (16) 

corresponds to the quantum Zeno effect when one can freeze the evolution of the quantum 
system by measuring it frequently enough [70]. 

Since the law of evolution of S may be considered as the definition of time t, one can 
introduce the quantity (energy) which is conserved during this evolution, 

(17) 

The energy E can be assumed to be proportional to some universal parameter of the world 
ensemble that characterizes the property of constant entanglement (10) for different ’classical’ 
systems and which can have the dimension of the speed to bound the Lieb-Robinson velocities 
of entanglement propagation [71]. Then, in our model there naturally emerges the concept of 
mass, 

E , , 

m = — , (18 

which characterizes the quasi-isolated system itself. 

4 Physical space 

The Relativity Principle we connect with the ambiguity of dehnition of three different types 
of entropy. For any physical system one can exchange constant additive terms of /, S and 
H with the rest of the universe, what does not affect dynamics of this system. Indeed, (i) 
the system can be situated in any ’place’ of world ensemble (uncertainty of information), (ii) 
can have any ’speed’ with respect to the universe (thermodynamic uncertainty due to ’heat’ 
supply to the system) and (hi) any particle of the system can be replaced by analogous particle 
of the world ensemble (entanglement uncertainty). These ambiguities in definitions of the 
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entropies, due to our assumption (8), would exhibit necessity in three distinct parameters to 
dehne transformations of the classical action, 

A = Et . (19) 

On the level of action this ’entropic symmetry’ can be parameterized by three spatial coordinates 
having the same character. For example, one can modify the classical action by adding of three 
extra terms, 

A' = A + mv^Xi, (i = l,2,3) (20) 

which are described by m and average Lieb-Robinson velocities, n*, and introduce the ’spatial’ 
dimensions, x*, in this manner. Then based on the relation (8) we can state that the less the 
probability of action transfer between two objects is, the further apart in this emergent space 
they are. 

One can speculate that connected with / dimension is subjective, while two other coordinates 
are objective, what can explain validity of the holography principle in held theory. 

The symmetry of the action with extra terms (20) to be reduced to the old form (19) (but 
with different energy) represents the Relativity Principle in emergent 4-dimensional ’space- 
time’ of our model. In terms of the unit of the actions, h, this symmetry can be written as 
de Broglie’s phase harmony, which leads to the Bohr-Sommerfeld quantization condition in old 
quantum mechanics. 


5 Inertial frames and gravitational potential 


The Equivalence Principle also appears to be encoded in the properties of quantum entropy. 
Any sub-system of hnite world ensemble which can be treated as isolated (external interactions 
are ignored) should have constant S and the condition (7) gives, 

dl = -dH . (21) 


This property of the entanglement entropy that the marginal entropies of pure bi-partite states 
are equal, while the entropy of the overall universe remains zero [29], means that for any physical 
system there exists the special state (inertial frame) in which information about the rest of the 
universe looks similar. 

For a system with some action A (or with the energy E) the relation (7) takes the form: 


dl = -dS - dH 


dE 


dH , 


where T is the temperature of local environment. Then 


dE 



A _ \ ^ 
V c^) h 


where we introduced the ’gravitational potential’. 


0 = hc‘ 


, dH 

ItA 


( 22 ) 


(23) 


(24) 


The case with constant entanglement, dH —)■ 0, i.e. 0^0, corresponds to the description of 
the universe by Minkowski space-time. 
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6 The equilibrium condition 

The Minimum Action and the Maximum Entropy principles, used in physics and information 
theory, can be unified in a single dynamical equilibrium condition of our model. 

Let us consider a physical system as a superposition of all its k conhgurations, not only the 
most probable ones with the highest entropy. According to (8), for the thermodynamic entropy 
we write 

= ( 25 ) 

k 

where are the actions of the configurations and (A) is the expected action of the system. So 
(25) relates the thermodynamic entropy to the number of possible arrangements of h in (A). 
In the states close to the thermodynamic equilibrium (i.e. having the largest entropies) the 
transfers of elementary action quanta should be minimal and the probabilities can be written 
as 

Pk = , (26) 

where 

z = (27) 

k 

is the partition function. Then 

Afc = -h (In Z + In Pk) (28) 

and (25) takes the Shannon’s form (2) up to the additive term In Z. 

The variation of the action expectation over all configurations of the physical system, h(A), 
in general is not equal to (hA). To amend this incompleteness of optimization one can consider 
the so called stochastic action principle [72,73], 

(M) = PkSAk = h(A) - = 0 . (29) 

k 

The last step in this formula follows from (26) and the trivial decomposition 

5(A) = 5 PkAk = {6A) + AkSPk . (30) 

k k 

If we introduce a temperature and a generalized heat, such that 

(31) 

equation (29) mimics the first law of thermodynamics. Note that the condition (29) is equivalent 
to a maximization of entropy 

iS = I - (M)) , (32) 

i.e. the maximum entropy principle in thermodynamics [68] and the least action principle in 
field theory can be unified into a single principle. 

For the systems which obey (14) the entropy in (29) is given by the Shannon’s formula 
(2). In general, the entanglement entropy H is not constant, that can be understood as the 


dissipation of information in the environment of a qnasi-isolated system. Then, as nsnal in 
mathematical descriptions of dissipative processes, the expression for S shonld be modified by 
addition of some complex terms: 


Stot = S + tJ2PnHn, (33) 

n 

where pn are the probabilities of interaction of the system with other n snbsystems of the 
nniverse. Using the analogies with Pk, which are related with Ak via the exponentials (26), we 
can assnme the Feynman’s form for the probability-action relation, 

Pn ~ . (34) 

Then we obtain the real value for the second term in Stot, which, like the first term, also takes 
the form of (2). Therefore, the total probability, which describes the behavior of particles of 
the selected system, can be written as the product of Pk and Pn and it imitates the structure 
of the wave function in quantum mechanics. If the action of the system is given by the form 
of an ideal fluid, then it can be cast into the action for the Schrodinger equation [67,74]. This 
suggests that the field variables and the space-time structure for quantum ensembles have the 
same origin and are not to be defined separately. 

Finally the main dynamical equation of our model (29) takes the form: 

= 0 , (35) 

and, in addition to the classical action A, contains different types of entropies in Stot- It is 
known that the Einstein’s equations can be obtained from the relation similar to (35), which 
is equivalent to the first law of thermodynamics [9,11]. For the recent progress in deriving the 
gravitational dynamics from the entanglement entropy see [75-78], and some attempts to apply 
the entanglement in cosmology are discussed in [79-82]. 

Note that the equilibrium condition of a physical system and the world ensemble in the form 
(35) can solve the old problem with the non-locality of the standard least action principle, since 
this difficulty of classical formulation (a physical system knows itself how to behave and what is 
the geodesic trajectory [83]; in nature there exist meaningless intentions and the present depends 
on the future events [84,85]) originates in the ignorance of quantum-information properties of 
physical systems. 

7 Discussion 

The main hypothesis of this paper is that the universe can be described as a single entangled 
ensemble of quantum particles which obey the Zero Entropy Principle (7). The consequence of 
this assumption for a classical subsystem with constant entanglement entropy, and which also 
obey the principle of maximum statistical entropy (S' is maximal and thus /, due to (14), is 
minimal), is that an observer has maximal information about real trajectories of the system 
and can track its motion. For a ’quantum system’ the information entropy, /, is large and he is 
not certain about its physical characteristics. In other words, an observer must be considered 
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as part of the experiment, gain of information by him reduces uncertainty of measurements and 
vice versa. One observable evidence of this statement of the model is that enough large number 
of observers, by the concentration on some prior, in principle are able to change the probability 
distribution for some random variable. 
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